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Abstract 

We further develop the group-theoretic approach to fast 
matrix multiplication introduced by Cohn and Umans, and 
for the first time use it to derive algorithms asymptotically 
faster than the standard algorithm. We describe several 
families of wreath product groups that achieve matrix multi- 
plication exponent less than 3, the asymptotically fastest of 
which achieves exponent 2.41. We present two conjectures 
regarding specific improvements, one combinatorial and the 
other algebraic. Either one would imply that the exponent 
of matrix multiplication is 2. 

1. Introduction 

The task of multiplying matrices is one of the most fun- 
damental problems in algorithmic linear algebra. Matrix 
multiplication itself is a important operation, and its impor- 
tance is magnified by the number of similar problems that 
are reducible to it. 

Following Strassen's discovery |8| of an algorithm for 
n X n matrix multiplication in 0{n^'^^) operations, a se- 
quence of improvements has achieved ever better bounds on 
the exponent of matrix multiplication, which is the small- 
est real number uj for which n x n matrix multiplication 
can be performed in 0(n'^+^) operations for each e > 0. 
The asymptotically fastest algorithm known is due to Cop- 
persmith and Winograd |3|, and it proves that uj < 2.376. 
Since 1990, there have been no better upper bounds proved 
on Lu, although it is widely believed that uj = 2. 

Recently, Cohn and Umans [2J proposed a new group- 
theoretic approach to devising matrix multiplication algo- 
rithms. In this framework, one selects a finite group G sat- 
isfying a certain property that allows n x n matrix multi- 
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plication to be reduced to multiplication of elements of the 
group algebra C[G]. This latter multiplication is performed 
via a Fourier transform, which reduces it to several smaller 
matrix multiplications, whose sizes are the character de- 
grees of G. This naturally gives rise to a recursive algorithm 
whose running time depends on the character degrees. Thus 
the problem of devising matrix multiplication algorithms in 
this framework is imported into the domain of group theory 
and representation theory. 

One of the main contributions of 1 2 1 was to demonstrate 
that several diverse families of non-abelian groups support 
the reduction of n x n matrix multiplication to group al- 
gebra multiplication. These include, in particular, families 
of groups of size n'^^°^^\ The existence of such families 
is a necessary condition for the group-theoretic approach to 
prove UJ = 2, although it is not sufficient. 

The main question raised in |2 1 is whether the proposed 
approach could prove nontrivial bounds on uj, i.e., prove 
UJ < 3. This was shown to be equivalent to a ques- 
tion in representation theory, Question 4.1 in t2||: is there 
a group G with subsets 81,82,83 that satisfy the triple 
product property (see Definition ll.3l below). and for which 
5*1 1 15*2 1 15*3 1 > J^i'^h where {di} is the set of character 
degrees of G? 

In this paper we resolve this question in the affirmative, 
which immediately gives a simple matrix multiplication al- 
gorithm in the group-theoretic framework that has running 
time ©(n^'^"^*). The group we construct for this purpose 
is a wreath product, and in subsequent sections we describe 
similar constructions that produce algorithms with running 
times 0(n2-48) and 0{n^ '^^). 

The main challenge in each case is to describe the three 
subsets of the group that satisfy the triple product property. 
We give two ways of organizing these descriptions, both of 
which give rise to the 0{n^-'^^) algorithm relatively simply. 
We also advance two natural conjectures related to these 
formulations, each of which would imply that uj ~ 2. The 
first is a combinatorial conjecture (Coniecture l3.4> . and the 
second is an algebraic conjecture (Coniecture l4.7> . 

The three subsets underlying the 0(n^'^^) algorithm 
are described in terms of a combinatorial object we call a 
Uniquely Solvable Puzzle (or USP), which is a weakening 
of the combinatorial object in our first conjecture. An op- 
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timal USP construction can be extracted from Coppersmith 
and Winograd's paper 1 3 1. 

In fact, the reader familiar with Strassen's 1987 paper JO) 
and Coppersmith and Winograd's paper [T] (or the presen- 
tation of this material in, for example, 1 1 1) will recognize 
that our exponent bounds of 2.48 and 2.41 match bounds 
derived in those works. It turns out that with some effort 
the algorithms in f9l and f3\, including Coppersmith and 
Winograd's 0{n^'^'^^) algorithm, all have analogues in our 
group-theoretic framework. The translation does not appear 
to be systematic: the algorithms are based on similar prin- 
ciples, but in fact they are not identical (the actual oper- 
ations performed on matrix entries do not directly corre- 
spond), and we know of no group-theoretic interpretations 
of any earlier algorithms. We defer a complete account of 
this connection to the full version of this paper. 

We believe that, compared to existing algorithms, our 
group-theoretic algorithms are simpler to state and simpler 
to analyze. They are situated in a clearer conceptual and 
mathematical framework, in which, for example, the two 
conjectures mentioned above are natural and easy to iden- 
tify. Finally, they avoid various complications of earlier al- 
gorithms. For example, they substitute the discrete Fourier 
transform, together with some elementary facts in represen- 
tation theory, for the seemingly ad hoc trilinear form identi- 
ties in introduced in 1 9 1, and they completely avoid the need 
to deal with degenerations and border rank of tensors. 

Outline. In the rest of this section, we establish notation 
and review background from 1 2 1 on the group-theoretic ap- 
proach to fast matrix multiplication. Section |2] describes 
the simplest group we have found that can prove a non- 
trivial bound on the exponent of matrix multiplication. In 
Sections Inland 13 we carry out a more elaborate construc- 
tion in two different ways, each of which has the poten- 
tial of reaching uj = 2. The most fundamental conceptual 
contribution in this paper is the simultaneous triple product 
property, which we introduce in Section |5] It extends the 
triple product property from |2 1, and it encompasses and il- 
luminates all of our other constructions, as we explain in 
Section |6l Finally, in Section we show that any bound 
provable via the simultaneous triple product property can in 
fact be proved using only the approach of |I2| . 

1.1. Preliminaries and notation 

As usual (jj denotes the exponent of matrix multiplication 
over C. 

The set {1,2,..., k} is denoted [k]. We write A\B ^ 
{a ^ A : a ^ B} and if A and B are subsets of an abeUan 
group we set A — B = {a — b : a & A, b ^ B}. 

The cyclic group of order k is denoted Cyc^, (with addi- 
tive notation for the group law), and the symmetric group on 



a set S is denoted Sym(S') (or Sym„ instead of Sym([n])). 
If G is a group and B is a ring, then R[G] will denote the 
group algebra of G with coefficients in R. 

When we discuss a group action, it will always be a left 
action unless otherwise specified. If G and H are groups 
with a left action of G on iJ (where the action of g on h 
is written g ■ h), then the semidirect product H xi G is the 
set H X G with the multiplication law {hi,gi), (/).2, 52) = 
{hi{gi ■ /i2), <?i52)- We almost always identify H with the 
subset H X {1} and G with {1} x G, so that {h, g) simply 
becomes the product hg. For a right action of G on H, with 
the action of g on h written , the semidirect product G k 
H is G X H with the multiplication law (171, /ii)(g2, ^2) — 
(.9152, /ii^ft.2)- As in the previous case we identify G and H 
with the corresponding subsets of G x H. 

Other than for Lemma n~2l which is not required for the 
main results of this paper, we will use only the following 
basic facts from representation theory. The group algebra 
C[G] of a finite group G decomposes as the direct prod- 
uct C[G] = C^i^"*! X • • • X C'^'=^'*'' of matrix algebras of 
orders di, . . . , dfe. These orders are the character degrees 
of G, or the dimensions of the irreducible representations. 
It follows from computing the dimensions of both sides that 
|G| = J2i '^i- is ^Iso easy to prove that if G has an abelian 
subgroup A, then all the character degrees of G are less than 
or equal to the index [G : A] (Proposition 2.6 in |4|) . See 
1 5 1 and 1 4 1 for further background on representation theory. 

The following elementary lemma (proof omitted) will 
prove useful several times: 

Lemma 1.1. Let si, S2, ■ ■ ■ , Sn be nonnegative real num- 
bers, and suppose that for every vector /i — (/ii, . . . , /i„) 
of nonnegative integers for which X]"=i l^-i — N we have 

Occasionally we will need to bound the character de- 
grees of wreath products: 

Lemma 1.2. Let {dk} be the character degrees of a finite 
group H and let {cj} be the character degrees o/Sym„ x 
if" (where Sym„ acts by permuting the coordinates). Then 

Sketch of proof. When H is abelian, the theorem follows 
from the elementary facts that the character degrees of 
Sym„ X iJ" are at most n! (which is the index of ii" in 
Sym„ X ii") and that J2j = |Sym„ x ii"|. For general 

H, we the theorem can be derived from well-known char- 
acterizations of the character degrees of Sym„ x if" (see, 
e.g.. Theorem 25.6 in |4|). □ 

I. 2. Background 

In this subsection we summarize the necessary defini- 
tions and results from ^ . 
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If S* is a subset of a group, let Q{S) denote the right 
quotient set of S, i.e., Q{S) = {sis^^ : si, S2 G S}. 

Definition 1.3 (|2 1). A group G realizes (ni, 712,713} ifthere 
are subsets 81,32,83 C G such that \Si\ = rii, and for 
qr e Q{8.,), if 

9i'?2g3 = 1 

then qi — q2 ~ ^ 1- We call this condition on 81, 82, 83 
the triple product property. 

Lemma 1.4 (0). IfG realizes {ni , n2, na), then it does so 
for every permutation of ni, n2, 713. 

Lemma 1.5 If 81,82,83 C G and S*;, S"^, S'^ C G' 
satisfy the triple product property, then so do the subsets 
81 X S[,82 X 5^, 5*3 X S*^ c G X G'. 

Theorem 1.6 (| 2 1). Let R be any algebra over C (not neces- 
sarily commutative). IfG realizes {71,111,, p), then the num- 
ber of ring operations required to multiply nxm with mxp 
matrices over R is at most the number of operations re- 
quired to multiply two elements of R[G]. 

One particularly useful construction from involves 
permutations of the points in a triangular array. Let 

A„ = {{a, b, c) £ : a + b + c = n - 1 and a,b,c> 0}. 

Geometrically, these triples are barycentric coordinates for 
a triangular array of points with n points along each side, 
but it is more convenient to manipulate them algebraically. 

For X G A„, we write x — {xi,X2,X3). Let Hi, H2, 
and H3 be the subgroups of Sym( A„ ) that preserve the first, 
second, and third coordinates, respectively. Specifically, 

Hi = {tt e Sym(A„) : {^{x))^ = x^ for all x G A„}. 

Tlieorem 1.7 (|2|). The subgroups Hi, H2, H3 defined 
above satisfy the triple product property. 

Tlieorem 1.8 (HI)- Suppose G realizes {71,771, p) and the 
characterdegreesofG are {di}. Then (nmp)'^^^ < '^^df. 

Combining Theorem ll.Sl with the fact that df = \G\ 
yields the following corollary, which is generally how the 
theorem is applied: 

Corollary 1.9 (O). Suppose G realizes {71, m,p) and has 
largest character degree d. Then (nmp)"/'^ < d^^'^\G\. 

2. Beating the sum of the cubes 

Suppose G realizes (n, 7n,p) and has character degrees 
{di}. Theorem ll .SI vields a nontrivial bound on uj (by ruling 
out the possibility of w = 3) if and only if 

nmp > . 



Question 4. 1 in Q asks whether such a group exists. In this 
section we construct one, which shows that our methods do 
indeed prove nontrivial bounds on uj. The rest of the paper 
is logically independent of this example, but it serves as 
motivation for later constructions. 

Let H = Cycfj, and let G ^ H^ x Cyc^, where Cyc2 
acts on H^ by switching the two factors of H. Let z denote 
the generator of Cyc^. We write elements of G in the form 
(a, b)z\ with a,b € H and i G {0, 1}. Note that z{a, b)z = 
ib,a). 

Let Hi, H2, H3 be the three factors of Cyc„ in the prod- 
uct H = Cyc^, viewed as subgroups of H. For notational 
convenience, let H4 = Hi . Define subsets 5i , 6*2 , ^3 C G 
by 8, = {ia,b)z^ : a G i/. \ {0},fe G H,+i,j G {0,1}}. 
We will prove in Lemma IzTI that these subsets satisfy the 
triple product property. 

To analyze this construction we need very little 
representation-theoretic information. The character degrees 
of G are all at most 2, because H^ is an abelian subgroup of 
index 2. Then since the sum of the squares of the character 
degrees is |G|, the sum of their cubes is at most 2|G|, which 
equals 4n^. 

On the other hand, [^^l = 2?7(n - 1), so |5i||S'2||S'3| = 
8n^{n — 1)^. For n > 5, this product is larger than 4n^. By 
CorollaryO (2n(n - 1))'^ < 2'^-22„6 ^jje best bound 
on ui is achieved by setting n = 17, in which case we obtain 
Lu < 2.9088. 

All that remains is to prove the triple product property: 

Lemma 2.1. 81, 82, and 83 satisfy the triple product prop- 
erty. 

Proof. Consider the triple product 91(7293 with qi G Q{8i), 
and suppose it equals the identity. Each quotient qi 
is either of the form {ai,bi){—a'^, ~b'-) or of the form 
{ai,bi)z{-a'^,-b'^), with ai,a'- G Hi and bi,b'^ G iJ^+i. 
There must be an even number of factors of z among the 
three elements Qi , 92, 93- 

First, suppose there are none. We can write qiq2q3 as 

{ai,bi){~a'i, -6i)(a2, 62)(-a2, -62)(a3, &3)(-a3> "^'3), 

where a^, G Hi and 6i, 6^ G -ffi+i. The product is thus 
equal to 

(ai - a'l + 02 - a'2 + 03 - 03, bi - b'l + &2 - &2 + ^3 - b'3), 

which is the identity iff gi = <?2 = <Z3 = 1, since the triple 
product property holds (trivially) for Hi,H2, H3 in H. 

Second, suppose two of qi,q2, 93 contain a z. The prod- 
uct qiq2q3 can be simplified as above to yield a sum in each 
coordinate, except now ai and contribute to different co- 
ordinates when qi contains a z, as do bi and b'^. There are 
thus two i's such that and contribute to different coor- 
dinates. For one of those two i's, and b^_^ contribute 
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to the same coordinate (where we interpret the subscripts 
modulo 3). The sum in the other coordinate contains one of 
fli and a'^ but neither of hi^i and h[_^, and thus only one 
summand from Hi (because for each j, Uj, a'j G Hj and 
bj, b'j e -ffj+i). Since Ui and are nonzero by the defini- 



tion of Si, the product (71(7293 cannot be the identity. 

3. Uniquely solvable puzzles 



□ 



In this section we define a combinatorial object called 
a strong USP, which gives rise to a systematic construc- 
tion of sets satisfying the triple product property in a wreath 
product. Using strong USPs we achieve oj < 2.48, and we 
conjecture that there exist strong USPs that prove oj = 2. 

3.1. USPs and strong USPs 

A uniquely solvable puzzle (USP) of width A: is a subset 
[/ C {1,2, 3}''' satisfying the following property: 

For all permutations 7ri,7r2,7r3 G Sym(J7), either 
TTi = 7r2 = TTa or else there exist u ^ U and i G [k] 
such that at least two of {TTi{u))i — 1, (7r2(w))i — 2, 
and {TT3{u))i — 3 hold. 

The motivation for the name "uniquely solvable puzzle" 
is that a USP can be thought of as a jigsaw puzzle. The 
puzzle pieces are the sets {i : Ui — \}, {i : Ui = 2}, and 
{i : Ui — 3} with u € U, and the puzzle can be solved by 
permuting these types of pieces according to tti, tt2, and tts, 
respectively, and reassembling them without overlap into 
triples consisting of one piece of each of the three types. 
The definition requires that the puzzle must have a unique 
solution. 

A strong USP is a USP in which the defining property is 
strengthened as follows: 

For all permutations 711,^2,7^3 G Sym(C/), either 
7Ti ^ 7T2 — TTa Or clsc there exist u G U and i G [k] 
such that exactly two of (7ri(u))i = 1, {7T2{u))i = 2, 
and (713(71) )i = 3 hold. 

One convenient way to depict USPs is by labelling a grid 
in which the rows correspond to elements of the USP and 
the columns to coordinates. The ordering of the rows is 
irrelevant. For example, the following labelling defines a 
strong USP of size 8 and width 6: 
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This construction naturally generaUzes as follows: 

Proposition 3.1. For each k > I, there exists a strong USP 
of size 2^ and width 2k. 

Proof. Viewing {1, 3}'= x {2, Z}^ as a subset of {1, 2, 3}^'=, 
we define U to be 

{liG {1,3}'' X {2,3}'= :fori G [k],u, = liffw^+fc = 2}. 

Suppose 7ri,7r2,7r3 G Sym([/). If tti 7^ 7T3, then there 
exists u E U such that {7Ti{u))i — 1 and (7r3(u))i — 3 
for some i G [k]. Similarly, if 712 ^ 7r3, then there exists 
u G U such that {7T2{u))i = 2 and (713 (u))^ = 3 for some 
i G [2k] \ [k]. In either case, exactly two of (7ri(u))i = 
1, {7i2{u))i = 2, and (713 (u))^ = 3 hold because in each 
coordinate only two of the three symbols 1, 2, and 3 can 
occur It follows that [/ is a strong USP, as desired. □ 

We define the strong USP capacity to be the largest con- 
stant C such that there exist strong USPs of size (C— o(l))'= 
and width k for infinitely many values of k. (We use the 
term "capacity" because this quantity is the Sperner capac- 
ity of a certain directed hypergraph, as we explain in Sec- 
tion|6l) The USP capacity is defined analogously. 

There is a simple upper bound for the USP capacity, 
which is of course an upper bound for the strong USP ca- 
pacity as well: 

Lemma 3.2. The USP capacity is at most 3/2^/'^. 

Sketch of proof. A USP of width k can have no repeated 
"puzzle pieces" (see the puzzle interpretation at the begin- 
ning of this section). It follows that the number of rows can 
be no larger than 0(/c2)(M ^ (3/22/3 + o(l))^ □ 



USPs turn out to be implicit in the analysis in Copper- 
smith and Winograd's paper |3 1, although they are not dis- 
cussed as such. Section 6 of 1 3 1 can be interpreted as giv- 
ing a probabilistic construction showing that Lemma lT2l is 
sharp: 

Theorem 3.3 (Coppersmith and Winograd 1 3 1). The USP 

capacity equals 3/2^^^. 

We conjecture that the same is true for strong USPs: 

Conjecture 3.4. The strong USP capacity equals 3/2'^^^. 

This conjecture would imply that uj ~ 2, as we explain 
in the next subsection. 

3.2. Using strong USPs 

Given a strong USP U of width k, let H be the abelian 
group of all functions from U x [k] to the cycUc group Cyc„j 



382 



(H is a group under pointwise addition). The symmetric 
group Sym(t/) acts on H via 

T:{h){u,i) = h{n^^{u),i) 

for TT G Sym(C/), h e H, u E U, and i e [fc]. 

Let G be the semidirect product H xi Sym([/), and de- 
fine subsets ^i, 5*2, and 6*3 of G by letting Si consist of all 
products tiTT with tt G Sym(C/) and h E H satisfying 

h{u,j) ^ iff Uj ~ i 

for all u e [/ and j G [fc] . 

Proposition 3.5. If U is a strong USP, then Si, S2, and S3 
satisfy the triple product property. 

Proof. Consider a triple product 

/Ii7ri7r5^"^/i']^^/i27r27r2~^/i2~^/i37r37r3~'^/i3~"'^ = 1 (3.1) 

with hiTZi, h[n[ G 5*^. For O.U to hold we must have 

TTiTTj 7r27r2 713713 = 1. (3.2) 

Set 7r = 7ri7r'^~^ and p = 7ri7r'^~^7r27r2~^. Then the remain- 
ing condition for j3.1> to hold is that in the abelian group H 
(with its Sym(C/) action), 

hi-h'^+ n{h2 - h[) + p{h3 - h'^) = 0. (3.3) 

Note that 

(/ii ^0 iff UjE{l,3}, 
7r(/i2 - K){u,j) ^ iff {7:-'{u))j G {2, 1}, and 
pih3-h',)iu,j)^0 iff (p-iH), G {3,2}. 

By the definition of a strong USP, either tt = p = 1 or 
else there exist u and j such that exactly one of these three 
conditions holds, in which case ( 13. 3t cannot hold. Thus, 
TT = p = 1, which together with ( 13. 2t implies TTi = tt'^ for 
all i. Then we have hi + /i2 + /i3 = h'^ + /ig + ^37 which 
implies /i^ ~ hi for each i (because for different choices 
of i they have disjoint supports). Thus, the triple product 
property holds. □ 

Analyzing this construction using Corollarv ll.9l and the 
bound [G : H] = |C/|! on the largest character degree of G 
yields the following bound: 

Corollary 3.6. IfU is a strong USP of width k, and m > 3 
is an integer, then uj < i^^°^™i^ — j7|fc'iog(m-i) ' partic- 
ular, if the strong USP capacity is C, then 

3(logTO - logC) 

UJ \ . 

~ log(m — 1) 

ProDosition B. ll vields oj < 2.67 with m = 9. In the next 
subsection we prove that the strong USP capacity is at least 
2^/^ and hence uj < 2.48, which is the best bound we know 
how to prove using strong USPs. 

If Coniecture l3.4l holds. then CoroUarv 13 .61 vields ui — 2 
upon taking m = 3. 



3.3. The triangle construction 

The strong USP constructed in Proposition 13 . 1 1 has the 
property that only two symbols (of the three possibilities 1, 
2, and 3) occur in each coordinate. Every USP with this 
property is a strong USP, and we can analyze exactly how 
large such a USP can be as follows. 

Suppose U C {1, 2, 3}'^' is a subset with only two sym- 
bols occurring in each coordinate. Let Hi be the subgroup 
of Sym([/) that preserves the coordinates in which only 1 
and 2 occur, H2 the subgroup preserving the coordinates in 
which only 2 and 3 occur, and H3 the subgroup preserving 
the coordinates in which only 1 and 3 occur. 

Lemma 3.7. The set U is a USP iff Hi, H2, and H^ satisfy 
the triple product property within Sym(t/). 

Proof. Suppose TTi , 7r2 , 7r3 G Sym([/). The permutation 
iTiiT2^ is not in Hi iff there exists v E U and a coordi- 
nate i such that Vi = 2 and {{TTin2^){v))i = 1. If we 
set u = TT2^{v), then this is equivalent to (7r2(u))i = 2 
and (7ri(u))i = 1. Similarly, t^2T^z^ ^ H2 iff there ex- 
ist u and i such that (7r2(M))i = 2 and (7r3(u))i — 3, and 
TTsTTi^ ^ H3 iff there exist u and i such that (7ri(u))i = 1 
and (7r3(u))i = 3. 

Thus, U is a USP iff for all tti, 712, tts, if 7ri7r2"^ G Hi, 
7r27r^^ G H2, and 7r37rj"^ G H3, then 7ri = 7r2 = n^. 
That is equivalent to the triple product property for Hi, H2, 
and H3: recall that because these are subgroups, the triple 
product property says that for hi E Hi, /11/12/13 = 1 iff 
hi — h2 = = 1. Any three elements /ii,/i2,/i3 satis- 
fying /ii/i2^3 = 1 can be written in the form hi = ttitt^^, 

^2 ~ '^2'^3^i and h^ = TT^TT^^. □ 

Proposition 3.8. For each k > 1, there exists a strong USP 
of size 2^^''-{2^ + 1) and width 3k. 

It follows that the strong USP capacity is at least 2'^^^ 
and a; < 2.48. 

Proof. Consider the triangle 

A„ = {(a, 6, c) G : a + 6 + c = n - 1 and a, 6, c > 0}, 

with n = 2'^, and let Hi, H2, and H3 be the subgroups 
of Sym(A„) preserving the first, second, and third coordi- 
nates, respectively. By Theorem I L 71 these subgroups sat- 
isfy the triple product property in Sym(A„). 

To construct the desired strong USP, choose a subset 
U C {1, 2, 3}'^'^ as follows. Among the first k coordinates, 
only 1 and 2 will occur, among the second k only 2 and 3, 
and among the third k only 1 and 3. In each of these three 
blocks of k coordinates, there are 2*^ possible patterns that 
be made using the two available symbols. Number these 
patterns arbitrarily from to 2'^ — 1 (each number will be 
used for three patterns, one for each pair of symbols). The 
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elements of U will correspond to elements of A„. In par- 
ticular, the element of U corresponding to (a, 6, c) G A„ 
will have the a-th pattern in the first k coordinates, the 6-th 
in the second fc, and the c-th in the third. It follows from 
Lemma|321that J7 is a strong USP. □ 

One can show using Lemma l3^ that this construction is 
optimal: 

Corollary 3.9. If U is a USP of width k such that only 
two symbols occur in each coordinate, then \U\ < (2^/"^ + 
oil))'. 

The condition of using only two symbols in each coor- 
dinate is highly restrictive, but we have been unable to im- 
prove on Proposition 13. 8 1 However, we know of no upper 
bound on the size of a strong USP besides Lemma l3T2l and 
we see no reason why Coniecture l3.4l should not be true. 

4. The simultaneous double product property 

There are at least two natural avenues for improving the 
construction from Subsection l3.3l In the combinatorial di- 
rection, one might hope to replace the strong USP of Propo- 
sition 13.81 with a larger one; this will reach exponent 2 if 
Coniecture l3.4l holds. In the algebraic direction, one might 
hope to keep the combinatorial structure of the triangle con- 
struction in place while modifying the underlying group. 
Such a modification can be carried out using the simultane- 
ous double product property defined below, and we conjec- 
ture that it reaches w = 2 as well (Coniecture l4.7> . 

We say that subsets 5*1 , 5*2 of a group H satisfy the dou- 
ble product property if 

(7192 = 1 implies = ^2 = 1, 

where qi e QiSi). 

Definition 4.1. We say that n pairs of subsets Ai, Bi (for 
1 < i < n) of a group H satisfy the simultaneous double 
product property ;/ 

• for all i, the pair Ai , Bi satisfies the double product 
property, and 

• for all i, j, k, 

ai{aj)^^bj{b'^)^^ = 1 implies i = k, 
where ai G Ai, a'- G Aj, bj G Bj, and b'^. G -B^. 
A convenient reformulation is that if one looks at the sets 

A:[^Bj = {a^^b : a e Ai,b e Bj}, 

those with i — j are disjoint from those with i ^ j- 

For a trivial example, set H = CycJ^^ x Cyc„, and set 
A, = {{x,i) : X G Cycfj and Bi = {(0,i)}. Then the 
pairs Ai, Bi for i G Cyc„ satisfy the simultaneous double 
product property. 



Lemma 4.2. Ifn pairs of subsets Ai, Bi C H satisfy the si- 
multaneous double product property, and n' pairs of subsets 
A[ , B[ C H' satisfy the simultaneous double product prop- 
erty, then so do the nn' pairs of subsets Ai x A'^ , Bi x Bj C 
H X H'. 

Pairs Ai , Bi satisfying the simultaneous double product 
property in group H can be transformed into subsets satis- 
fying the triple product property via a construction similar 
to the one in Section|3] Recall that 

A„ = {{a, b, c) e : a + b + c = n - I and a,b, c > 0}. 

Given n pairs of subsets Ai ,Bi in H for < i < n — 
1, we define triples of subsets in indexed by v = 

{vi,V2,V3) G A„ as follows: 

Ay — Ay-^ X {1} X By^ 

By = By^ X Ay^ X {l} 

Cy = {1} X By^ X Ay^ 

Theorem 4.3. Ifn pairs of subsets Ai,Bi C H (with < 
i < n — 1 j satisfy the simultaneous double product property, 
then the following subsets 81,82,83 of G = (H^)^" x 
Sym(A„) satisfy the triple product property: 

81 — {air : tt G Sym(A„),a^, G Ay for all v} 

82 — {bn : n e Sym{An), by e By for all v} 

83 ~ {cTT : n e Sym{An), Cy G Cy for all v} 

The proof uses Theorem II. 71 and is similar to the proof 
of Proposition l3.51 it can be found in the full version of this 
paper 

Theorem 4.4. If H is a finite group with character degrees 
{dk}, and n pairs of subsets Ai, Bi Q H satisfy the simul- 
taneous double product property, then 

n / \ 3/2 

\ k / 

Using this theorem, the example after Definition l4.1l re- 
covers the trivial bound uj < 3 as k ^ 00. 

Proof of Theorem^^ Let A[,B[ be the TV-fold direct 
product of the pairs Ai, Bi via Lemma l4!2l and let /i be 
an arbitrary n-vector of nonnegative integers for which 
— ^ ■ Among the pairs A[, B[ are M = (^) pairs 
for which \A[\\B[\ = nUid^ill-Sil)^'; call this quantity 
L. SetP= |Aa/|,soP = M(A/+1)/2. The three subsets 
in Theorem l4.3l each have size P\L^ . By Theorem ll.8l and 
LemmaOwe obtain (PIL'")'^ < (Pl)'^-^ (J^k ^tf^^ ■ 
Taking 2P-th roots and letting N 00 yields 

/ \ / " \ '^/2 / \ 3N/2 

C) (n(M.iiB.ir) <-{e<) ^ 
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Finally, we apply Lemma [TTTI with Si = {\Ai\\Bi\)'^^'^ and 
C = (J2k ^fc )^^^ obtain the stated inequahty. □ 

It is convenient to use two parameters a and f3 to describe 
pairs satisfying the simultaneous double product property: 
if there are n pairs, choose a and (3 so that > n" 

for all i and \H\ — n^. If H is abelian Theorem l4.4l implies 
uj < (3/3-2)/a. 

The best construction we know is the following: 

Proposition 4.5. For each m > 2, there is a construction in 
Cyc^ satisfying the simultaneous double product property 
with a — log2(m — 1) + o(l) and (3 = log2 m + o(l) as 

Taking m — 6 yields exactly the same bound as in Sub- 
sectionl331(tj < 2.48). 

Proof. Let n = (2/). Then n = 22^(i-°(i)) so /3 = 
log2 TO + o(l). For each subset S of the 2i coordinates 
of Cyc^ with 15*1 = ^, let As be the set of elements that are 
nonzero in those coordinates and zero in the others. Let S 
denote the complement of S, and set Bs = A-g. For each S, 
we have jAsHSsI — (m — 1)^^, so a = log2(m — 1) +o(l). 

We will show that the pairs As, Bs satisfy the simulta- 
neous double product property. Each pair As, Bs clearly 
satisfies the double product property, because the elements 
of As and Bs are supported on disjoint sets of coordinates. 
Each element of Bs — As is nonzero in every coordinate, 
but if Q R then there is a coordinate in i? n Q (note 
that this is why we require \Q\ = \R\). Each element of 
Bq — Afi vanishes in that coordinate, so 

[Bq - Ar) n (Bs - v4s) = 

as desired. □ 

The only limitations we know of on the possible values 
of a and jS are the following: 

Proposition 4.6. Ifn pairs of subsets Ai, Bi C H satisfy 
the simultaneous double product property, with \Ai\\Bi\ > 
n" for all i and \H\ — n^, then a < (3 and q + 2 < 2/3. 

Sketch of proof The inequality a < (3 follows immediately 
from the double product property; the second inequality is 
proved using the fact that the sets Ai, . . . , An are pairwise 
disjoint, as are Bi, . . . , _B„. □ 

The most important case is when H is an abelian group. 
There the bound on a; is < (3/3 — 2) /a, and Propo- 
sition 14.61 shows that the only way to achieve u; = 2 is 
a = (3 = 2. We conjecture that that is possible: 

Conjecture 4.7. For arbitrarily large n, there exists an 
abelian group H with n pairs of subsets Ai , Bi satisfy- 
ing the simultaneous double product property such that 

\H\ = n^+°W and \A\\B^\ > n^-°^^\ 



5. The simultaneous triple product property 

Each of our constructions of a group proving a nontrivial 
bound on oj has the same general form, namely a semidirect 
product of a permutation group with an abelian group. The 
crucial part of such a construction is the way in which the 
abelian part is apportioned among the three subsets satisfy- 
ing the triple product property. 

This apportionment can be viewed as reducing sev- 
eral independent matrix multiplication problems to a single 
group algebra multiplication, using triples of subsets satis- 
fying the simultaneous triple product property: 

Definition 5.1. We say that n triples of subsets Ai, Bi, Ci 
(for I < i < n) of a group H satisfy the simultaneous triple 
product property if 

• for each i, the three subsets Ai, Bi, d satisfy the triple 
product property, and 

• for all i, j, k, 

ai{a'j)~^bj{b'f.)^^Ck{ciy^ = 1 implies i=j = k 
for tti e Ai, a'j e Aj, bj e Bj, b'f. e Bk, Cfc e Ck and 

4 e a. 

We say that such a group simultaneously realizes 

{\A,\,\B,\,\Ci\),...,{\Ar,\,\Br,\,\Cn\). 

In most applications the group H will be abelian, in 
which case it is more conventional to use additive notation. 
In this notation the implication above becomes 

Qi — a'j + bj — b'j^ + Cfe ~ c'i ~ implies i ~ j ~ k. 

As an example, let H — Cyc^, and call the three factors 
Hi, H2, and H3. Define the following sets: 

Ai - i/i \ {0}, Bi^H2\ {0}, Ci^H^X {0} 
A2^H2\ {0}, B^^HsX {0}, C2 - i/i \ {0} 

This construction is based on the one in Section |2] except 
that this one is shghtly more symmetrical. 

Proposition 5.2. The two triples Ai,Bi, Ci and 
A2, B2, C2 satisfy the simultaneous triple product property. 

Sketch of proof. Each triple clearly satisfies the triple prod- 
uct property in isolation, so we need only deal with the 
second condition in the definition. Fori G {1,2} define 
U, = A, - Ci, = B,- A„ and ^ C, - B,. The 
theorem follows from arguing that if Ui + Vj+Wk — (with 
Ui e Ui, Vj e Vj, and G Wk) then i = j = k. □ 

The reason for the strange condition in the definition of 
the simultaneous triple product property is that it is exactly 
what is needed to reduce several independent matrix multi- 
plications to one group algebra multiplication. 



385 



Theorem 5.3. Let R be any algebra over C. // H simul- 
taneously realizes (ni,TOi,pi), . . . , {nk,mk,Pk), then the 
number of ring operations required to perform k indepen- 
dent matrix multiplications of sizes nixmi by miX pi, . . . , 
Uk X ruk by nik x pk is at most the number of operations 
required to multiply two elements of R[H]. 

The proof is similar to that of Theorem ll.6l 

Proof. Suppose H simultaneously realizes (ni,mi,pi), 
{nk,mk,Pk) via triples Ni,Mi,Pi with 1 < i < k. 
Let Ai be an Ui x nii matrix and Bi an rrii x pi matrix. We 
will index the rows and columns of Ai with the sets Ni and 
Mi, respectively, those of Bi with Mi and Pi, and those of 
AiBi with Ni and Pi. 

Consider the product of these two elements of R[H]: 

k k 

i=i seNi.teMi i=i t'eMi,uePi 

We have (s"4)(t'"iii) = s'~^u' with s e N,t e M^, 
t' e Mj, u e Pj, s' e Nk, and u' G Pfc iff i = j = fc 
and s = s', t = t' , and u = u' , so the coefficient of s^^u 

in the product is X;tgT(^i)s,t(A)t,« = Thus, 
one can simply read off the matrix products from the group 
algebra product by looking at the coefficients of s^^u with 
s ^ Ni,u ^ Pi, and the theorem follows. □ 

Other results about the triple product property also gen- 
eralize straightforwardly to the simultaneous triple product 
property, such as the following lemma: 

Lemma 5.4. If n triples of subsets Ai, Bi,Ci C H sat- 
isfy the simultaneous triple product property, and n' triples 
of subsets A'j, B'j, Cj C H' satisfy the simultaneous triple 
product property, then so do the nn' triples of subsets 
A, X A'j,B, X B'j,C., xC'j<ZH X H'. 

By Schonhage's asymptotic sum inequality ((15.11) in 
lITI). one can deduce a bound on oj from the simultaneous 
triple product property: 

Theorem 5.5. // a group H simultaneously realizes 
(fli, bi, ci), . . . , (a„, bn, c„) and has character degrees 
{dk}, then Etli<^^b,c,r/^ < Y.^^d%. 

Frequently H will be abelian, in which case ~ 
\H\. That occurs in the example from Proposition 15.21 
which proves that < 2.93 using Theorem l5.5l 

In Section we provide a proof of Theorem 15.51 com- 
pletely within our group-theoretic framework, and show 
furthermore that any bound on lo that can be achieved us- 
ing the simultaneous triple product property can also be 
achieved using the ordinary triple product property. Thus, 
there is no added generality from the simultaneous triple 
product property, but it is an important organizing princi- 
ple. 



6. Using the simultaneous triple product prop- 
erty 

Every construction we have found of a group proving 
a nontrivial bound on u has at its core a simultaneous 
triple product property construction in an abelian group. 
Each construction also involves a wreath product, but as 
explained in Section that is a general tool for dealing 
with the simultaneous triple product property. Given Theo- 
rem]^] which can be proved either via the wreath product 
construction of Sectional or using the asymptotic sum in- 
equality, one can dispense with non-abelian groups entirely. 
In this section we explain how to interpret each of our con- 
structions in this setting. 

6.1. Local strong USPs 

A local strong USP of width fc is a subset U C {1,2, 3}*^ 
such that for each ordered triple (u, v, w) £ U^, with u, v, 
and w not all equal, there exists i G [k] such that {ui, Vi, Wi) 
is an element of 

{(1,2,1), (1,2,2), (1,1,3), (1,3,3), (2,2,3), (3,2,3)}. 

Lemma 6.1. Every local strong USP is a strong USP. 

The proof is straightforward, and omitted from this ver- 
sion of the paper 

The reason for the word "local" is that local strong USPs 
satisfy a condition for every triple of rows, rather than a 
weaker global condition on permutations. The advantage of 
local strong USPs is that they lead naturally to a construc- 
tion satisfying the simultaneous triple product property: 

Theorem 6.2. Let U be a local strong USP of width k, and 
for each u U define subsets A^, B„, C„ C Cyc^ by 

Au = {x e Cyc\ -.Xj^O iff Uj = 1}, 
By = {x e Cyc^ : Xj ^0 iff uj = 2}, and 
Cu = {xe Cyc^ -.Xj^O iff = 3}. 

Then the triples Au, Bu, C„ satisfy the simultaneous triple 
product property. 

Note that this construction isolates the key idea behind 
Proposition l3.5l 

Proof. Suppose u,v,w ^ U are not all equal and 

a« - a'„ + bv - b'uj + Cw - c'u = 

with a„ e Au, a'^ G A,„, by e By, b'y, G B^y, c„ G C^, 
and c'y G Cy. By the definition of a local strong USP, there 
exists i G [k] such that {ui,Vi, Wi) is in 

{(1,2,1), (1,2,2), (1,1,3), (1,3, 3), (2, 2,3), (3,2,3)}. 
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In each of these cases exactly one of a„, a^, 6^, 
is nonzero, namely a'^, b^, a„, cj^, b'^, and Cw, respectively. 
Thus, in each case the equation a„ + 6„ + c^, = aj, + 6^ + 
is impossible, so u = v ~ w, as desired. 

All that remains is to show that for each u, the sets 
Au ,Bu,Cu satisfy the triple product property, which is triv- 
ial (they are supported on disjoint sets of coordinates). □ 

At first glance the definition of a local strong USP ap- 
pears far stronger than that of a strong USP. For example, 
the strong USPs constructed in Subsection l3.3l are not local 
strong USPs. However, it turns out that any bound on oj that 
can be proved using strong USPs can be proved using local 
strong USPs: 

Proposition 6.3. The strong USP capacity is achieved by 
local strong USPs. In particular, given any strong USP U 
of width k, there exists a local strong USP of size \U\l and 
width \ U\k. 

Proof. Let [/ be a strong USP of width k, and fix an arbi- 
trary ordering ui, U2, ■ ■ ■ , u\(ji of the elements of U. For 
each TT e Sym(;7), let C/^ G {1, 2, 3}l^l'' be the concatena- 
tion of 7r(wi), 7r(M2), . . . ,7r(u|[/|). Then the set of all vec- 
tors Utt is a local strong USP: given any three elements Ut^^ , 
[/tts, and Utt^ with vri, 7r2, tts not all equal, by the definition 
of a strong USP there exist u and i G [k] such that ex- 
actly two of {■Ki{u))i = 1, {■K2{u))i = 2, and {iTz{u))i = 3 
hold. Then in the coordinate indexed by u and i, the vectors 
Utti, Utt^, and [/^g have entries among (1,2,1), (1,2,2), 
(1, 1, 3), (1, 3, 3), (2, 2, 3), (3, 2, 3), as desired. □ 

Proposition 16 . 31 explains the choice of the word "capac- 
ity": optimizing the size of a local strong USP amounts to 
determining the Sperner capacity of a certain directed hy- 
pergraph(see |7| for background on Sperner capacity). The 
full version of this paper will explain this perspective more 
completely. 

6.2. Triangle-free sets 

The construction in Theorem 14.31 is also easily inter- 
preted in terms of the simultaneous triple product property. 
Recall the construction of triples Ay, By, Cy indexed by 
V G A„, defined before Theorem l4.3l These triples almost 
satisfy the simultaneous triple product property, in the fol- 
lowing sense: if au{a'y)~^by{b'^)~^Cw{c'^)~^ = 1 then it 
follows from the simultaneous double product property that 
ui ~ wi, V2 = U2, and w-^ — V3. Call a subset S of 
A„ triangle-free if for all u,v,w £ S satisfying ui — wi, 
V2 — U2, and ^3 — W3, it follows that u = v — w. Thus, 
the triples Ay, By, Cy with u in a triangle-free subset of A„ 
satisfy the triple product property. 



The critical question is whether there is a triangle-free 
subset of A„ of size |A„|i-°(i). We give a simple con- 
struction achieving this using Salem-Spencer sets (see |6 1). 
Let T be a subset of [[n/2j] of size n^^"^^") that contains 
no three-term arithmetic progression. The following lemma 
is easily proved: 

Lemma 6.4. The subset {(a, b, c) 6 A„ : b — a e T} is 
triangle-free and has size |A„|^~°(^^. 

6.3. Local USPs and generalizations 

USPs also have a local version, just as strong USPs do. A 
local USP is defined analogously to a local strong USP, ex- 
cept that the triple (1, 2, 3) is allowed in addition to (1, 2, 1), 
(1,2,2), (1,1,3), (1,3,3), (2,2,3), and (3,2,3). Local 
USPs are USPs, and they achieve the USP capacity; the 
proofs are analogous to those for Lemma 16.11 and Propo- 
sition [O] In what follows we place this construction in a 
far broader context: 

Definition 6.5. Let H be a finite abelian group. An H- 
chart C = (F, A, B, C) consists of a finite set of symbols F, 
together with three mappings A, B,C : F — > 2^ such that 
for each x G F, the sets A{x), B{x), G{x) satisfy the triple 
product property. Let 7i(C) C F^ denote the set of ordered 
triples {x, y, z) such that 

^ A{x) - A{y) + B{y) - B{z) + C{z) - C{x). 

A local C-USP of width k is a subset U C F*"' such that 
for each ordered triple (u, v, w) G U'^, with u, v, w not all 
equal, there exists i G [k] such that (ui, Vi, Wi) G Ti.(C). 

For example, a local USP is a C-USP for the Cyc^-chart 
C = ({1, 2, 3}, A, B, C) with A, B, C defined as follows 
(below, # = Cyc^\ {0,1}): 

A(1) = {0} B{l) = -H C{1)^{0} 
A{2)^{1} B{2) = {0} C{2) = H 
A{S) = H B{3) ^ {0} C(3) = {0} 

Tlieorem 6.6. Let H be a finite abelian group, C an H- 
chart, and U a local C-USP of width k. For each u ^ U 
define subsets A^ , B^ , C„ C by 

Ay^\[A{u,), By^\[B{u,), Cu^\{C{u,). 

2—1 i—1 i—1 

Then these triples of subsets satisfy the simultaneous triple 
product property. 

Together with the example above, this theorem gives 
an analogue of Theorem 16.21 for local USPs. Using The- 
orem]^] this example achieves uo < 2.41. 

Using a more complicated chart with 24 symbols, the 
bound lli < 2.376 from |3| may be derived from Theo- 
rem]^] For details, see the full version of this paper. 
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7. The wreath product construction 

It remains to prove Theorem 15.51 using purely group- 
theoretic means. Besides giving a self-contained proof, this 
will also show that the ordinary triple product property from 
Definition ^21 is as strong as the simultaneous triple prod- 
uct property, in the sense that any bound that can be derived 
from Theorem l5.5l can be proved using Theorem ll.8l as well. 

To prove Theorem l5.5l we make use of a wreath product 
construction. Let H he a group, and define G = Sym„ K 
where the symmetric group Sym„ acts on from the 
right by permuting the coordinates according to {h'^)i = 
h^i^iy We write elements of G as /ivr with h G iJ" and 
TT e Sym„. 

Theorem 7.1. Ifn triples of subsets Ai, Bi,Ci C H satisfy 
the simultaneous triple product property, then the following 
subsets Hi,H2,H3 of G = Sym^ k iJ" satisfy the triple 
product property: 

Hi = {fiTT : TT G Sym^, hi G Ai for each i} 
H2 — {fiTT : TT G Sym„, hi G Bi for each i} 
i?3 — {hn : TT G Sym„, hi G C,; for each i} 

Proof. The proof is analogous to that of Proposition 13.51 
Consider a triple product 

hi7ri7r[-^h'-^h2n2TT'f^h'2'^h3TT3TT'f^h'-^ = 1 (7.1) 

with hi'Ki^h'iTi'i G Hi. (Note that these subscripts index 
hi,h2,h3, rather than describing coordinates of a single 
h ^ H. Once understood that should not cause confusion.) 
For (17. 1> to hold we must have 

/—I /—I /—I 1 /T o\ 

TTiTT^ 71271^ TTaTTg = 1. (7.2) 

Set TT — ttitt'j^^ and p = tt\tt'i^tt2Tt'2^ . Then the remain- 
ing condition for (17. 1> to hold is that in the group iJ" with 
its right Sym„ action, 

h!^^hi{]^{^h2Y{h!^^h^Y ^\ 

In other words, for each coordinate i. 

By the simultaneous triple product property, we find 
that it(i) — p(i) — i. Thus, tt = p — 1, which to- 
gether with (17. 2> implies tt^ — tt^ for all i. Finally, we 
have hih'^^h2h'^'^h^h'^^ = 1, which implies hi = h[, 
h2 = h'2, and h^ = h'^ because each triple Ai,Bi, d satis- 
fies the triple product property. □ 

The proof of Theorem 15.51 follows the same outline as 
the proof of Theorem l4.4l 



Proof of Theorem\53\ Let A^, B'i, C[ be the iV-fold direct 
product (via Lemma 1541 of the triples Ai,Bi,Ci realiz- 
ing (ai, 61, ci), . . . , (a„, bn, Cn), and let p be an arbitrary 
n-vector of nonnegative integers for which X]r=i l^i ~ 
Among the triples A^,Bj',C- are M = (^) triples for 
which \A[\\B[\\C[\ =nr=iK^»Ci)'''; call this quantity i. 

Using these triples in Theorem 17.11 we obtain subsets 
ffi,i?2,i?3 with liJilliJallffal = {M\fL^'. Applying 
Theorem [Ts] and Lemma O we get ({MlfL^^y/^ < 

{Miy-^ {Y.k'K)^^'^ ■ Taking Af-th roots and letting 
N ^ 00 yields 

Finally, we apply Lemma [TTTI with Si — (aibiCi)'^^"^ and 
C = to obtain the stated inequality. □ 
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